root@Observium:/opt/observium# ./poller.php -d -m unix-agent -h <removed>
DEBUG!
Observium 0.15.2.6288
Poller
Starting polling run:
SQL[SELECT `device_id` FROM `devices` WHERE `disabled` = 0 AND `hostname` LIKE ' <removed>' ORDER BY `device_id` ASC]
RUNTIME[0.00048518s]
SQL[SELECT * FROM `devices` WHERE `device_id` = '19']
RUNTIME[0.00009894s]
SQL[SELECT * FROM `devices_attribs` WHERE `device_id` = '19']
RUNTIME[0.00005889s]
SQL[SELECT * FROM `alert_tests` WHERE 1]
RUNTIME[0.00007296s]
Cached 7 alert rules.
SQL[SELECT *,`alert_table`.`alert_table_id` AS `alert_table_id` FROM `alert_tab le` LEFT JOIN `alert_table-state` ON `alert_table`.`alert_table_id` = `alert_ table-state`.`alert_table_id` WHERE `device_id` = '19']
RUNTIME[0.00031686s]
<removed> 19 linux (unix)
CMD[/usr/bin/fping -t 500 -c 1 -q 10.50.50.38 2>&1]
EXITCODE[0]
RUNTIME[0.0046s]
STDOUT[
10.50.50.38 : xmt/rcv/%loss = 1/1/0%, min/avg/max = 0.82/0.82/0.82
]
CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUst -m SNMPv2-MIB -M /opt/observium/mib s/rfc:/opt/observium/mibs/net-snmp 'udp':'<removed>':'161' sysObjectID.0 sysU pTime.0]
EXITCODE[0]
RUNTIME[0.0054s]
STDOUT[
sysObjectID.0 = enterprises.8072.3.2.10
sysUpTime.0 = 34388037
]
SNMP_STATUS[TRUE]
RRD /opt/observium/rrd/<removed>/status.rrd already exists - no need to creat e.
RRD[cmd[update /opt/observium/rrd/<removed>/status.rrd N:1]
stdout[OK u:0.00 s:0.00 r:0.01]
stderr[]]
RRD /opt/observium/rrd/<removed>/ping.rrd already exists - no need to create.
RRD[cmd[update /opt/observium/rrd/<removed>/ping.rrd N:0.82]
stdout[OK u:0.00 s:0.00 r:0.01]
stderr[]]
RRD /opt/observium/rrd/<removed>/ping_snmp.rrd already exists - no need to cr eate.
RRD[cmd[update /opt/observium/rrd/<removed>/ping_snmp.rrd N:6.23]
stdout[OK u:0.00 s:0.00 r:0.01]
stderr[]]
SQL[SELECT * FROM `device_graphs` WHERE `device_id` = '19']
RUNTIME[0.00009298s]
including: includes/polling/unix-agent.inc.php
Observium UNIX Agent:
SQL[SELECT attrib_value FROM devices_attribs WHERE `device_id` = '19' AND `attri b_type` = 'agent_port']
RUNTIME[0.00010300s]
execution time: 1210msRRD /opt/observium/rrd/<removed>/agent.rrd already exis ts - no need to create.
RRD[cmd[update /opt/observium/rrd/<removed>/agent.rrd N:1210]
stdout[OK u:0.00 s:0.00 r:1.23]
stderr[]]
Array
(
[] =>
[Observium] => Version: 1.0.1
AgentOS: linux
PluginsDirectory: /usr/lib/observium_agent/plugins
LocalDirectory: /usr/lib/observium_agent/local
AgentDirectory: /etc/observium
OnlyFrom: 127.0.0.1 ::1 10.52.52.3 10.52.52.1
[df] => rootfs rootfs 188 9391592 1603927176 189488892 90% /
udev devtmpfs 10240 0 10240 0% /dev
/dev/disk/by-uuid/c9c4cf53-f7b8-4711-962a-9bd3878976bf ext4 1889391592 1603 927176 189488892 90% /
[mounts] => /dev/disk/by-uuid/c9c4cf53-f7b8-4711-962a-9bd3878976bf / ext4 rw ,relatime,errors=remount-ro,user_xattr,barrier=1,data=ordered 0 0
[ps] => (root,10652,680,0.0) init [2]
(root,0,0,0.0) [kthreadd]
(root,0,0,0.0) [ksoftirqd/0]
(root,0,0,0.0) [migration/0]
(root,0,0,0.0) [watchdog/0]
(root,0,0,0.0) [migration/1]
(root,0,0,0.0) [ksoftirqd/1]
(root,0,0,0.0) [watchdog/1]
(root,0,0,0.0) [migration/2]
(root,0,0,0.0) [kworker/2:0]
(root,0,0,0.0) [ksoftirqd/2]
(root,0,0,0.0) [watchdog/2]
(root,0,0,0.0) [migration/3]
(root,0,0,0.0) [kworker/3:0]
(root,0,0,0.0) [ksoftirqd/3]
(root,0,0,0.0) [watchdog/3]
(root,0,0,0.0) [migration/4]
(root,0,0,0.0) [kworker/4:0]
(root,0,0,0.0) [ksoftirqd/4]
(root,0,0,0.0) [watchdog/4]
(root,0,0,0.0) [migration/5]
(root,0,0,0.0) [ksoftirqd/5]
(root,0,0,0.0) [watchdog/5]
(root,0,0,0.0) [migration/6]
(root,0,0,0.0) [ksoftirqd/6]
(root,0,0,0.0) [watchdog/6]
(root,0,0,0.0) [migration/7]
(root,0,0,0.0) [ksoftirqd/7]
(root,0,0,0.0) [watchdog/7]
(root,0,0,0.0) [migration/8]
(root,0,0,0.0) [ksoftirqd/8]
(root,0,0,0.0) [watchdog/8]
(root,0,0,0.0) [migration/9]
(root,0,0,0.0) [ksoftirqd/9]
(root,0,0,0.0) [watchdog/9]
(root,0,0,0.0) [migration/10]
(root,0,0,0.0) [ksoftirqd/10]
(root,0,0,0.0) [watchdog/10]
(root,0,0,0.0) [migration/11]
(root,0,0,0.0) [ksoftirqd/11]
(root,0,0,0.0) [watchdog/11]
(root,0,0,0.0) [cpuset]
(root,0,0,0.0) [khelper]
(root,0,0,0.0) [kdevtmpfs]
(root,0,0,0.0) [netns]
(root,0,0,0.0) [sync_supers]
(root,0,0,0.0) [bdi-default]
(root,0,0,0.0) [kintegrityd]
(root,0,0,0.0) [kblockd]
(root,0,0,0.0) [kworker/1:1]
(root,0,0,0.0) [khungtaskd]
(root,0,0,0.0) [kswapd0]
(root,0,0,0.0) [ksmd]
(root,0,0,0.0) [khugepaged]
(root,0,0,0.0) [fsnotify_mark]
(root,0,0,0.0) [crypto]
(root,0,0,0.0) [kworker/8:1]
(root,0,0,0.0) [kworker/3:1]
(root,0,0,0.0) [kworker/2:1]
(root,0,0,0.0) [kworker/4:1]
(root,0,0,0.0) [kworker/5:1]
(root,0,0,0.0) [kworker/7:1]
(root,0,0,0.0) [kworker/6:1]
(root,0,0,0.0) [kworker/11:1]
(root,0,0,0.0) [kworker/10:1]
(root,0,0,0.0) [khubd]
(root,0,0,0.0) [scsi_eh_0]
(root,0,0,0.0) [ata_sff]
(root,0,0,0.0) [scsi_eh_1]
(root,0,0,0.0) [scsi_eh_2]
(root,0,0,0.0) [scsi_eh_3]
(root,0,0,0.0) [scsi_eh_4]
(root,0,0,0.0) [scsi_eh_5]
(root,0,0,0.0) [scsi_eh_6]
(root,0,0,0.0) [kworker/u:4]
(root,0,0,0.0) [kworker/u:5]
(root,0,0,0.0) [jbd2/sda1-8]
(root,0,0,0.0) [ext4-dio-unwrit]
(root,21380,800,0.0) udevd --daemon
(root,0,0,0.0) [kworker/5:2]
(root,184,28,0.0) runsvdir -P /etc/service log: ................................ ................................................................................ ................................................................................ ................................................................................ ................................................................................ ...........................................
(root,0,0,0.0) [kworker/8:2]
(root,0,0,0.0) [flush-8:0]
(root,9964,876,0.0) dhclient -v -pf /run/dhclient.eth0.pid -lf /var/lib/dhcp/dhc lient.eth0.leases eth0
(root,21376,536,0.0) udevd --daemon
(root,4120,468,0.0) /usr/sbin/acpid
(root,71840,2924,0.0) /usr/sbin/apache2 -k start
(daemon,16676,12,0.0) /usr/sbin/atd
(root,20412,952,0.0) /usr/sbin/cron
(root,20172,2940,0.0) -bash
(104,29960,1020,0.0) /usr/bin/dbus-daemon --system
(root,193100,3164,0.0) /usr/sbin/console-kit-daemon --no-daemon
(101,46816,552,0.0) /usr/sbin/exim4 -bd -q30m
(root,188468,2652,0.0) /usr/lib/policykit-1/polkitd --no-debug
(root,352124,21444,0.0) /opt/dell/srvadmin/sbin/dsm_sa_datamgrd
(root,202456,224,0.0) /opt/dell/srvadmin/sbin/dsm_sa_datamgrd
(root,189836,3412,0.0) /opt/dell/srvadmin/sbin/dsm_sa_eventmgrd
(root,140872,3952,0.0) /opt/dell/srvadmin/sbin/dsm_sa_snmpd
(root,4184,408,0.0) /bin/sh /data/moloch/bin/run_capture_corp.sh
(root,4184,408,0.0) /bin/sh /data/moloch/bin/run_capture_china.sh
(root,29320,372,0.0) /opt/dell/srvadmin/sbin/dsm_om_connsvcd -run
(root,938576,207960,0.0) /opt/dell/srvadmin/sbin/dsm_om_connsvcd -run
(root,49936,592,0.0) /usr/sbin/sshd
(root,16260,740,0.0) /sbin/getty 38400 tty1
(root,16260,740,0.0) /sbin/getty 38400 tty2
(root,16260,740,0.0) /sbin/getty 38400 tty3
(root,16260,740,0.0) /sbin/getty 38400 tty4
(root,16260,740,0.0) /sbin/getty 38400 tty5
(root,16260,740,0.0) /sbin/getty 38400 tty6
(root,21376,532,0.0) udevd --daemon
(root,20228,3000,0.0) -bash
(root,20148,2908,0.0) -bash
(root,20160,2924,0.0) -bash
(root,134124,41980,0.0) /opt/chef/embedded/bin/ruby /usr/bin/chef-client -d -i 3 600 -s 10 -P /var/run/chef-client.pid
(root,0,0,0.0) [kworker/0:0]
(root,0,0,0.0) [kworker/11:0]
(root,19568,952,0.0) /usr/sbin/xinetd -pidfile /var/run/xinetd.pid -stayalive -i netd_compat -inetd_ipv6
(root,0,0,0.0) [kworker/0:2]
(root,17560,1144,0.0) tmux attach
(root,0,0,0.0) [kworker/9:2]
(root,0,0,0.0) [kworker/10:2] eth2 -i eth3
(snmp,50196,5080,0.0) /usr/sbin/snmpd -LSed -Lf /dev/null -u snmp -g snmp -I -sm ux -p /var/run/snmpd.pid
(root,9244,1396,0.0) /bin/bash /usr/bin/observium_agent
[mem] => MemTotal: 16421324 kB
MemFree: 180096 kB
Buffers: 6880 kB
Cached: 5260468 kB
SwapCached: 106076 kB
Active: 10567188 kB
Inactive: 3913352 kB
Active(anon): 8207100 kB
Inactive(anon): 1030808 kB
Active(file): 2360088 kB
Inactive(file): 2882544 kB
Unevictable: 1380536 kB
Mlocked: 1380536 kB
SwapTotal: 33459196 kB
SwapFree: 31925176 kB
Dirty: 155120 kB
Writeback: 0 kB
AnonPages: 10499256 kB
Mapped: 677588 kB
Shmem: 320 kB
Slab: 186780 kB
SReclaimable: 157648 kB
SUnreclaim: 29132 kB
KernelStack: 4760 kB
PageTables: 36632 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 41669856 kB
Committed_AS: 12885424 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 312488 kB
VmallocChunk: 34359419727 kB
HardwareCorrupted: 0 kB
AnonHugePages: 0 kB
HugePages_Total: 0
HugePages_Free: 0
HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
DirectMap4k: 95168 kB
DirectMap2M: 9295872 kB
DirectMap1G: 7340032 kB
[cpu] => 3.70 2.73 3.78 4/581 23492 12
[uptime] => 2679171.86 30768716.38
[netif] => eth3 1000Mb/s Full on yes
eth2 1000Mb/s Full on yes
eth1 Unknown! Unknown!(255) on no
eth0 1000Mb/s Full on yes
tun0 10Mb/s Full off yes
[lnx_if:sep(58)] => eth3: 5487798722 11625188 0 34 0 0 0 4240028 468 6 0 0 0 0 0 0
lo: 166218605737 44011630 0 0 0 0 0 0 16621860 5737 44011630 0 0 0 0 0 0
eth2: 4701397360349 6262412725 0 69176 0 0 0 22009645 468 6 0 0 0 0 0 0
eth1: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
eth0: 8570770388 52431864 0 5 0 4071 0 25264178 5833077794 7593529 0 0 0 0 0 0
tun0: 132660390 1356871 0 0 0 0 0 0 3459297463 2 544585 0 0 0 0 0 0
[eth3]
Speed: 1000Mb/s
Duplex: Full
Auto-negotiation: on
Link detected: yes
[lo]
Link detected: yes
[eth2]
Speed: 1000Mb/s
Duplex: Full
Auto-negotiation: on
Link detected: yes
[eth1]
Speed: Unknown!
Duplex: Unknown! (255)
Auto-negotiation: on
Link detected: no
[eth0]
Speed: 1000Mb/s
Duplex: Full
Auto-negotiation: on
Link detected: yes
[tun0]
Speed: 10Mb/s
Duplex: Full
Auto-negotiation: off
Link detected: yes
[tcp_conn_stats] => ESTABLISHED 235
[md] =>
[diskstat] => 1424442085
8 0 sda 5438254 33671 333115606 37280032 61198740 40852047 11365739480 1527982396 1 61867144 1565635592
[kernel] => 1424442085
nr_free_pages 45373
nr_inactive_anon 257702
nr_active_anon 2052100
nr_inactive_file 719859
nr_active_file 590022
nr_unevictable 345134
nr_mlock 345134
nr_anon_pages 2624911
nr_mapped 169494
nr_file_pages 1342641
nr_dirty 39653
nr_writeback 0
nr_slab_reclaimable 39412
nr_slab_unreclaimable 7283
nr_page_table_pages 9352
nr_kernel_stack 595
nr_unstable 0
nr_bounce 0
nr_vmscan_write 595259
nr_vmscan_immediate_reclaim 156793
nr_writeback_temp 0
nr_isolated_anon 0
nr_isolated_file 0
nr_shmem 80
nr_dirtied 1541339601
nr_written 1382833957
numa_hit 3387608533
numa_miss 0
numa_foreign 0
numa_interleave 17796
numa_local 3387608533
numa_other 0
nr_anon_transparent_hugepages 0
nr_dirty_threshold 733011
nr_dirty_background_threshold 366505
pgpgin 166557931
pgpgout 5682869740
pswpin 335692
pswpout 595259
pgalloc_dma 1
pgalloc_dma32 671613946
pgalloc_normal 2721203094
pgalloc_movable 0
pgfree 3392912332
pgactivate 230559659
pgdeactivate 4519585
pgfault 2538779135
pgmajfault 478608
pgrefill_dma 0
pgrefill_dma32 582962
pgrefill_normal 3961772
pgrefill_movable 0
pgsteal_dma 0
pgsteal_dma32 304333190
pgsteal_normal 947473308
pgsteal_movable 0
pgscan_kswapd_dma 0
pgscan_kswapd_dma32 304873843
pgscan_kswapd_normal 950216170
pgscan_kswapd_movable 0
pgscan_direct_dma 0
pgscan_direct_dma32 17365
pgscan_direct_normal 62578
pgscan_direct_movable 0
zone_reclaim_failed 0
pginodesteal 0
slabs_scanned 73583616
kswapd_steal 1251732570
kswapd_inodesteal 1944428
kswapd_low_wmark_hit_quickly 401
kswapd_high_wmark_hit_quickly 464898
kswapd_skip_congestion_wait 3
pageoutrun 4755645
allocstall 484
pgrotated 747448
compact_blocks_moved 1507
compact_pages_moved 45037
compact_pagemigrate_failed 215
compact_stall 58
compact_fail 4
compact_success 54
htlb_buddy_alloc_success 0
htlb_buddy_alloc_fail 0
unevictable_pgs_culled 15033
unevictable_pgs_scanned 0
unevictable_pgs_rescued 17150
unevictable_pgs_mlocked 362751
unevictable_pgs_munlocked 17150
unevictable_pgs_cleared 0
unevictable_pgs_stranded 0
unevictable_pgs_mlockfreed 0
thp_fault_alloc 0
thp_fault_fallback 0
thp_collapse_alloc 0
thp_collapse_alloc_failed 0
thp_split 0
cpu 117769198 4819368 6597191 3068923323 7223186 11154 596965 0 0 0
cpu0 11762818 722343 1714078 245418314 3468499 11154 555164 0 0 0
cpu1 15284780 287835 1530184 248538737 938031 0 8584 0 0 0
cpu2 12976210 156421 986865 252289409 613472 0 7753 0 0 0
cpu3 11631844 137608 516485 254283712 755846 0 7717 0 0 0
cpu4 12667396 126155 474712 253442789 634569 0 7740 0 0 0
cpu5 12946697 106455 460018 253412956 421765 0 7974 0 0 0
cpu6 6044917 511639 150098 261027742 55754 0 295 0 0 0
cpu7 5981168 581818 141922 261041625 58776 0 264 0 0 0
cpu8 6556101 551995 148757 260472588 57305 0 423 0 0 0
cpu9 6698563 600204 153730 260254816 66370 0 302 0 0 0
cpu10 7201588 507035 157158 259806316 77335 0 297 0 0 0
cpu11 8017111 529855 163179 258934314 75458 0 446 0 0 0
intr 10395424325 8974 0 0 2 2 0 0 0 1 108 106261323 0 0 0 0 0 0 0 0 0 0 0 32 108 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 7 636918414 581345578 622097399 693555023 6753730 91 497946503 675576651 486394800 64009307 26926 5 6262150 2253992 2109199 238341 4 2003270 2003490 2148818 2047470 628 15363040 2733245 3551881 2432542 1 1 1 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ctxt 36640670536
btime 1421762912
processes 4426292
procs_running 3
procs_blocked 0
softirq 4139704009 0 602380262 1605661 632578394 63333298 0 63670783 271120263 2 078615928 426399420
[netctr] => 1424442085
eth3 5487798722 11625188 0 34 0 0 0 4240028 468 6 0 0 0 0 0 0
lo 166218618482 44011638 0 0 0 0 0 0 16621861 8482 44011638 0 0 0 0 0 0
eth2 4701398204582 6262413725 0 69176 0 0 0 22009645 468 6 0 0 0 0 0 0
eth1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
eth0 8570770388 52431864 0 5 0 4071 0 25264178 5833077794 7593529 0 0 0 0 0 0
tun0 132661742 1356897 0 0 0 0 0 0 3459306767 2 544612 0 0 0 0 0 0
[megaraid_pdisks] => adapter 0
dev2enc Enclosure 0 Device ID 32
Adapter #0
Enclosure Device ID: 32
Slot Number: 0
Enclosure position: 1
Device Id: 0
Raw Size: 1.819 TB [0xe8e088b0 Sectors]
Firmware state: Online, Spun Up
Inquiry Data: WMC1P0DLRFRHWD2000FYYX 00.0D1 K4
Enclosure Device ID: 32
Slot Number: 1
Enclosure position: 1
Device Id: 1
Raw Size: 1.819 TB [0xe8e088b0 Sectors]
Firmware state: Online, Spun Up
Inquiry Data: WMC1P0DH69DYWD2000FYYX 00.0D1 K4
[megaraid_ldisks] => Adapter 0 -- Virtual Drive Information:
Virtual Drive: 0 (Target Id: 0)
Name :Virtual Disk 0
Size : 1.818 TB
Sector Size : 512
State : Optimal
Strip Size : 64 KB
Number Of Drives : 2
[megaraid_bbu] => Adapter 0: Get BBU Status Failed.
FW error description:
The required hardware component is not present.
[ntp] =>
[local] =>
[hdarray] => Controller Status=Ok
Drive List of Physical Disks on Controller PERC H310 Mini (Embedded)=List of Phy sical Disks on Controller PERC H310 Mini (Embedded)
Drive Controller PERC H310 Mini (Embedded)=Controller PERC H310 Mini (Embedded)
Drive ID=Status
Drive 0:1:0=Ok
Drive 0:1:1=Ok
List of Physical Disks on Controller PERC H310 Mini (Embedded) Controller PERC H 310 Mini (Embedded) ID;Status;Name;State;Power Status;Bus Protocol;Media;Part of Cache Pool;Remaining Rated Write Endurance;Failure Predicted;Revision;Driver Ve rsion;Model Number;T10 PI Capable;Certified;Encryption Capable;Encrypted;Progres s;Mirror Set ID;Capacity;Used RAID Disk Space;Available RAID Disk Space;Hot Spar e;Vendor ID;Product ID;Serial No.;Part Number;Negotiated Speed;Capable Speed;PCI e Maximum Link Width;PCIe Negotiated Link Width;Sector Size;Device Write Cache;M anufacture Day;Manufacture Week;Manufacture Year;SAS Address 0:1:0;Ok;Physical D isk 0:1:0;Online;Spun Up;SATA;HDD;Not Applicable;Not Applicable;No;00.0D1K4;Not Applicable;Not Applicable;No;Yes;No;Not Applicable;Not Applicable;Not Applicable ;1,862.50 GB (1999844147200 bytes);1,862.50 GB (1999844147200 bytes);0.00 GB (0 bytes);No;DELL(tm);WD2000FYYX;WMC1P0DLRFRH;MY0NRG1W125554B74089A02;3.00 Gbps;3.0 0 Gbps;Not Applicable;Not Applicable;512B;Not Applicable;Not Available;Not Avail able;Not Available;4433221104000000 0:1:1;Ok;Physical Disk 0:1:1;Online;Spun Up; SATA;HDD;Not Applicable;Not Applicable;No;00.0D1K4;Not Applicable;Not Applicable ;No;Yes;No;Not Applicable;Not Applicable;Not Applicable;1,862.50 GB (19998441472 00 bytes);1,862.50 GB (1999844147200 bytes);0.00 GB (0 bytes);No;DELL(tm);WD2000 FYYX;WMC1P0DH69DY;MY0NRG1W125554B74083A02;3.00 Gbps;3.00 Gbps;Not Applicable;Not Applicable;512B;Not Applicable;Not Available;Not Available;Not Available;443322 1105000000
[app] => Array
(
[molochcapture] => proccesses:2
[suricata] => 2
)
[munin] => Array
(
[resque] =>
)
)
Munin Plugins:Array
(
[resque] =>
)
SQL[SELECT * FROM `munin_plugins` WHERE `device_id` = '19']
RUNTIME[0.00007701s]
SQL[SELECT * FROM `munin_plugins_ds` AS D, `munin_plugins` AS P WHERE P.`mplug_i d` = D.`mplug_id` AND P.`device_id` = '19']
RUNTIME[0.00006795s]
Plugin: resque ID: 1No include:
No include: Observium
No include: df
No include: mounts
No include: ps
No include: mem
No include: cpu
No include: uptime
No include: netif
No include: lnx_if:sep(58)
No include: tcp_conn_stats
No include: md
No include: diskstat
No include: kernel
No include: netctr
No include: megaraid_pdisks
No include: megaraid_ldisks
No include: megaraid_bbu
No include: ntp
No include: local
Including: unix-agent/hdarray.inc.php
Array
(
[0] => Controller Status=Ok
[1] => Drive List of Physical Disks on Controller PERC H310 Mini (Embedded)= List of Physical Disks on Controller PERC H310 Mini (Embedded)
[2] => Drive Controller PERC H310 Mini (Embedded)=Controller PERC H310 Mini (Embedded)
[3] => Drive ID=Status
[4] => Drive 0:1:0=Ok
[5] => Drive 0:1:1=Ok
[6] => List of Physical Disks on Controller PERC H310 Mini (Embedded) Contro ller PERC H310 Mini (Embedded) ID;Status;Name;State;Power Status;Bus Protocol;Me dia;Part of Cache Pool;Remaining Rated Write Endurance;Failure Predicted;Revisio n;Driver Version;Model Number;T10 PI Capable;Certified;Encryption Capable;Encryp ted;Progress;Mirror Set ID;Capacity;Used RAID Disk Space;Available RAID Disk Spa ce;Hot Spare;Vendor ID;Product ID;Serial No.;Part Number;Negotiated Speed;Capabl e Speed;PCIe Maximum Link Width;PCIe Negotiated Link Width;Sector Size;Device Wr ite Cache;Manufacture Day;Manufacture Week;Manufacture Year;SAS Address 0:1:0;Ok ;Physical Disk 0:1:0;Online;Spun Up;SATA;HDD;Not Applicable;Not Applicable;No;00 .0D1K4;Not Applicable;Not Applicable;No;Yes;No;Not Applicable;Not Applicable;Not Applicable;1,862.50 GB (1999844147200 bytes);1,862.50 GB (1999844147200 bytes); 0.00 GB (0 bytes);No;DELL(tm);WD2000FYYX;WMC1P0DLRFRH;MY0NRG1W125554B74089A02;3. 00 Gbps;3.00 Gbps;Not Applicable;Not Applicable;512B;Not Applicable;Not Availabl e;Not Available;Not Available;4433221104000000 0:1:1;Ok;Physical Disk 0:1:1;Onli ne;Spun Up;SATA;HDD;Not Applicable;Not Applicable;No;00.0D1K4;Not Applicable;Not Applicable;No;Yes;No;Not Applicable;Not Applicable;Not Applicable;1,862.50 GB ( 1999844147200 bytes);1,862.50 GB (1999844147200 bytes);0.00 GB (0 bytes);No;DELL (tm);WD2000FYYX;WMC1P0DH69DY;MY0NRG1W125554B74083A02;3.00 Gbps;3.00 Gbps;Not App licable;Not Applicable;512B;Not Applicable;Not Available;Not Available;Not Avail able;4433221105000000
)
hdarray: 1Discover sensor: state, <removed>, , 1, unix-agent-state, Controlle r Status: Ok, 1, , , , , 1, agent, , controller
SQL[SELECT COUNT(`sensor_id`) FROM `sensors`
WHERE `poller_type`= 'agent' AND `sensor_class` = 'state' AND `device_id` = '19' AND `sensor_type` = 'unix-agent-state' AND `sensor_index` = '1']
RUNTIME[0.00003910s]
SQL[SELECT * FROM `sensors` WHERE `sensor_class` = 'state' AND `device_id` = '19 ' AND `sensor_type` = 'unix-agent-state' AND `sensor_index` = '1']
RUNTIME[0.00006104s]
.Status: Ok istatus: 1Discover sensor: state, <removed>, , 5, unix-agent-stat e, Drive 0:1:0: Ok, 1, , , , , 1, agent, , storage
SQL[SELECT COUNT(`sensor_id`) FROM `sensors`
WHERE `poller_type`= 'agent' AND `sensor_class` = 'state' AND `device_id` = '19' AND `sensor_type` = 'unix-agent-state' AND `sensor_index` = '5']
RUNTIME[0.00005007s]
SQL[SELECT * FROM `sensors` WHERE `sensor_class` = 'state' AND `device_id` = '19 ' AND `sensor_type` = 'unix-agent-state' AND `sensor_index` = '5']
RUNTIME[0.00004292s]
.Status: Ok istatus: 1Discover sensor: state, <removed>, , 6, unix-agent-stat e, Drive 0:1:1: Ok, 1, , , , , 1, agent, , storage
SQL[SELECT COUNT(`sensor_id`) FROM `sensors`
WHERE `poller_type`= 'agent' AND `sensor_class` = 'state' AND `device_id` = '19' AND `sensor_type` = 'unix-agent-state' AND `sensor_index` = '6']
RUNTIME[0.00004101s]
SQL[SELECT * FROM `sensors` WHERE `sensor_class` = 'state' AND `device_id` = '19 ' AND `sensor_type` = 'unix-agent-state' AND `sensor_index` = '6']
RUNTIME[0.00006008s]
.Status: Ok istatus: 1
No include: app
No include: munin
Processes:
Sensors:
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'tempe rature' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller _type` = 'agent']
RUNTIME[0.00049305s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'humid ity' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_ty pe` = 'agent']
RUNTIME[0.00027585s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'fansp eed' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_ty pe` = 'agent']
RUNTIME[0.00032496s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'airfl ow' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_typ e` = 'agent']
RUNTIME[0.00027204s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'volta ge' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_typ e` = 'agent']
RUNTIME[0.00027204s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'curre nt' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_typ e` = 'agent']
RUNTIME[0.00029993s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'power ' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_type` = 'agent']
RUNTIME[0.00026989s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'apowe r' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_type ` = 'agent']
RUNTIME[0.00027609s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'imped ance' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_t ype` = 'agent']
RUNTIME[0.00027609s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'frequ ency' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_t ype` = 'agent']
RUNTIME[0.00026989s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'dbm' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_type` = 'agent']
RUNTIME[0.00027323s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'snr' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_type` = 'agent']
RUNTIME[0.00030208s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'capac ity' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_ty pe` = 'agent']
RUNTIME[0.00028396s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'load' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_type` = 'agent']
RUNTIME[0.00027990s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'runti me' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_typ e` = 'agent']
RUNTIME[0.00027895s]
SQL[SELECT * FROM `sensors` AS S, `devices` AS D WHERE S.`sensor_class` = 'state ' AND S.`device_id` = D.`device_id` AND D.`device_id` = '19' AND S.`poller_type` = 'agent']
RUNTIME[0.00035906s]
1 -> unix-agent-state
5 -> unix-agent-state
6 -> unix-agent-state
Module [ unix-agent ] time: 1.248s
including: includes/polling/system.inc.php
CMD[/usr/bin/snmpget -v2c -c *** -Pu -OQUs -m SNMPv2-MIB -M /opt/observium/mibs /rfc:/opt/observium/mibs/net-snmp 'udp':'<removed>':'161' sysUpTime.0 sysLoca tion.0 sysContact.0 sysName.0]
EXITCODE[0]
RUNTIME[0.0056s]
STDOUT[
sysUpTime.0 = 3:23:31:21.63
sysLocation.0 = <removed>
sysContact.0 = <removed>
sysName.0 = <removed>
]
SNMP_STATUS[TRUE]
CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m SNMPv2-MIB -M /opt/observium/mibs/ rfc:/opt/observium/mibs/net-snmp 'udp':'<removed>':'161' sysDescr.0]
EXITCODE[0]
RUNTIME[0.0051s]
STDOUT[
Linux <removed> 3.2.0-4-amd64 #1 SMP Debian 3.2.65-1+deb7u1 x86_64
]
SNMP_STATUS[TRUE]
CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqvn -m SNMPv2-MIB -M /opt/observium/mibs /rfc:/opt/observium/mibs/net-snmp 'udp':'<removed>':'161' sysObjectID.0]
EXITCODE[0]
RUNTIME[0.0049s]
STDOUT[
.1.3.6.1.4.1.8072.3.2.10
]
SNMP_STATUS[TRUE]
CMD[/usr/bin/snmpget -v2c -c *** -Pu -Ovqn -m SNMP-FRAMEWORK-MIB -M /opt/observ ium/mibs/rfc:/opt/observium/mibs/net-snmp 'udp':'<removed>':'161' snmpEngineI D.0]
EXITCODE[0]
RUNTIME[0.0041s]
STDOUT[
"80 00 1F 88 80 05 A4 A6 6A A6 3B B9 54 00 00 00
00 "
]
SNMP_STATUS[TRUE]
Using UNIX Agent Uptime (2679172 sec. => 31 days, 12m 52s)
RRD /opt/observium/rrd/<removed>/uptime.rrd already exists - no need to creat e.
RRD[cmd[update /opt/observium/rrd/<removed>/uptime.rrd N:2679172]
stdout[OK u:0.00 s:0.00 r:1.29]
stderr[]]
Uptime: 31 days, 12m 52s
SQL[SELECT `version` FROM `dbSchema`;]
RUNTIME[0.00012302s]
SQL[SELECT * FROM `devices_locations` WHERE `device_id` = '19']
RUNTIME[0.00004292s]
Module [ system ] time: 0.0263s
including: includes/polling/os.inc.php
SQL[SELECT * FROM `entPhysical` WHERE `device_id` = '19' AND `entPhysicalContain edIn` = '0']
RUNTIME[0.00006986s]
CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m MIB-Dell-10892 -M /opt/observium/m ibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/dell 'udp':'sensor-corp 1':'161' chassisModelName.1]
EXITCODE[0]
RUNTIME[0.0197s]
STDOUT[
"PowerEdge R320"
]
SNMP_STATUS[TRUE]
CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m MIB-Dell-10892 -M /opt/observium/m ibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/dell 'udp':'sensor-corp 1':'161' chassisServiceTagName.1]
EXITCODE[0]
RUNTIME[0.0188s]
STDOUT[
"12ABC12"
]
SNMP_STATUS[TRUE]
CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m MIB-Dell-10892 -M /opt/observium/m ibs/rfc:/opt/observium/mibs/net-snmp:/opt/observium/mibs/dell 'udp':'sensor-corp 1':'161' chassisAssetTagName.1]
EXITCODE[0]
RUNTIME[0.0187s]
STDOUT[
"<removed> O"
]
SNMP_STATUS[TRUE]
CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m UCD-SNMP-MIB -M /opt/observium/mib s/rfc:/opt/observium/mibs/net-snmp 'udp':'<removed>':'161' .1.3.6.1.4.1.2021. 7890.1.3.1.1.6.100.105.115.116.114.111]
EXITCODE[0]
RUNTIME[0.0054s]
STDOUT[
No Such Object available on this agent at this OID
]
SNMP_STATUS[FALSE]
CMD[/usr/bin/snmpget -v2c -c *** -Pu -Oqv -m UCD-SNMP-MIB -M /opt/observium/mib s/rfc:/opt/observium/mibs/net-snmp 'udp':'<removed>':'161' .1.3.6.1.4.1.2021. 7890.1.101.1]
EXITCODE[0]
RUNTIME[0.0054s]
STDOUT[
No Such Object available on this agent at this OID
]
SNMP_STATUS[FALSE]
Hardware: Dell PowerEdge R320 x86 [64bit] Version: 3.2.0-4-amd64 Features: Seri al: 94KGG42 Asset: <removed> O
Module [ os ] time: 0.0734s
Graphs [checked]: ping, ping_snmp, agent, uptime
Polled in 1.3665 seconds
Updating <removed> - Array
(
[uptime] => 2679172
[last_polled] => Array
(
[0] => NOW()
)
[last_polled_timetaken] => 1.3665
[device_state] => a:1:{s:15:"poller_mod_perf";a:3:{s:10:"unix-agent";s:6:"1. 2480";s:6:"system";s:6:"0.0263";s:2:"os";s:6:"0.0734";}}
)
SQL[UPDATE `devices` set `uptime` ='2679172',`last_polled` =NOW(),`last_polled_t imetaken` ='1.3665',`device_state` ='a:1:{s:15:\"poller_mod_perf\";a:3:{s:10:\"u nix-agent\";s:6:\"1.2480\";s:6:\"system\";s:6:\"0.0263\";s:2:\"os\";s:6:\"0.0734 \";}}' WHERE `device_id` = '19']
RUNTIME[0.00105596s]
UPDATED!
Checking alerts
Array
(
[device_status] => 1
[device_status_type] =>
[device_ping] => 0.82
[device_snmp] => 6.23
[device_uptime] => 2678934
[device_duration_poll] => 1.75
)
Checking alert 5 associated by 6
Testing: device_status equals 0 (value: 1) OK Checks OK.
SQL[UPDATE `alert_table-state` set `state` ='{\"metrics\":{\"device_status\":\"1 \"}}',`count` ='0',`alert_status` ='1',`last_message` ='Checks OK',`last_checked ` ='1424441969' WHERE `alert_table_id` = '300']
RUNTIME[0.00014210s]
RRD /opt/observium/rrd/<removed>/alert-300.rrd already exists - no need to cr eate.
RRD[cmd[update /opt/observium/rrd/<removed>/alert-300.rrd N:1:1]
stdout[OK u:0.00 s:0.00 r:1.37]
stderr[]]
SQL[INSERT INTO `perf_times` (`type`,`doing`,`start`,`duration`,`devices`) VALU ES ('poll','<removed>','1424441968.4136','1.380','1')]
RUNTIME[0.00015116s]
./poller.php: <removed> - 1 devices polled in 1.380 secs
NOTE, $config['snmp']['hide_auth'] sets as TRUE, snmp community and snmp v3 auth hidden from debug output.
Memory usage: 4.75MB (peak: 5MB)
MySQL: Cell[4/0s] Row[7/0s] Rows[7/0.01s] Column[0/0s] Update[2/0s] Insert[1/0s] Delete[0/0s]